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ABSTRACT 



In 1990, the National Assessment of Educational Progress 
(NAEP) included a Trial State Assessment (TSA) ; for the first time in the 
NAEP's history, voluntary state-by-state assessments were made. The sample 
was designed to represent the 8th grade public school population in a state 
or territory. In 1996, 44 states, the District of Columbia, Guam, and the 
Department of Defense schools, took part in the NAEP state science assessment 
program. The NAEP 1996 state science assessment was at grade 8 only, although 
grades 4, 8, and 12 were assessed at the national level as usual. The 1996 
state science assessment covered three major fields: earth, physical, and 
life sciences. In South Carolina, 2,162 students in 91 public schools were 
assessed. This report describes the science proficiency of South Carolina 
eighth-graders, compares their overall performance to students in the 
Southeast region of the United States and the entire United States (using 
data from the NAEP national assessment) , presents the average proficiency for 
the three major fields, and summarizes the performance of subpopulations 
(gender, race/ethnicity, parents' educational level, Title I participation, 
and free/reduced lunch program eligibility) . To provide a context for the 
assessment data, participating students, their science teachers, and 
principals completed questionnaires which focused on: instructional content 
(curriculum coverage, amount of homework) ,- delivery of science instruction 
(availability of resources, type) ,- use of computers in science instruction ,- 
educational background of teachers; and conditions facilitating science 
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learning (e.g., hours of television watched, absenteeism). On the NAEP fields 
of science scales that range from 0 to 300, South Carolina students had an 
average proficiency of 139 compared to 148 throughout the United States. The 
average science scale score of males was higher than that of females in South 
Carolina; nationwide, however, the performance of males did not differ 
significantly from that of females. At the eighth grade, White students in 
South Carolina had an average science scale score that was higher than those 
of Black and Hispanic students. (DDR/NB) 



******************************************************************************** 



* Reproductions supplied by EDRS are the best that can be made * 

* from the original document . * 

******************************************************************************** 




ED 413 230 







Hi 


NATIONAL 


CENTER 


FOR EDUCATION STATISTICS 



NAEP 1996 SCIENCE 

State Report for 
South Carolina 



U S. DEPARTMENT OF EDUCATION 
Office of Educational Research and Improvement 

EDUCATIONAL RESOURCES INFORMATION 
CENTER (ERIC) 

m This document has been reproduced as 

7>©c€wed from the person or organization 
originating it. 

□ Minor changes have been made to 
improve reproduction quality. 

• Points of view or opinions stated in this 
document do not necessarily represent 
official OERI position or policy. 




BEST COPY AVAILABLE 



U.S. DEPARTMENT OF 
EDUCATION OFFICE OF 
EDUCATIONAL RESEARCH 
AND IMPROVEMENT 



Findings from the National 
Assessment of Educational Progress 



What is The Nation’s Report Card? 

THE NATION’S REPORT CARD, the National Assessment of Educational Progress (NAEP), is the only nationally representative and 
continuing assessment of what America’s students know and can do in various subject areas. Since 1969, assessments have been conducted 
periodically in reading, mathematics, science, writing, history/geography, and other fields. By making objective information on student 
performance available to policymakers at the national, state, and local levels, NAEP is an integral part of our nation’s evaluation of the 
condition and progress of education. Only information related to academic achievement is collected under this program. NAEP guarantees 
the privacy of individual students and their families. 

NAEP is a congressionally mandated project of the National Center for Education Statistics, the U.S. Department of Education. The 
Commissioner of Education Statistics is responsible, by law, for carrying out the NAEP project through competitive awards to qualified 
organizations. NAEP reports directly to the Commissioner, who is also responsible for providing continuing reviews, including validation 
studies and solicitation of public comment, on NAEP’s conduct and usefulness. 

In 1988, Congress established the National Assessment Governing Board (NAGB) to formulate policy guidelines for NAEP. The 
Board is responsible for selecting the subject areas to be assessed from among those included in the National Education Goals; for setting 
appropriate student performance levels; for developing assessment objectives and test specifications through a national consensus 
approach; for designing the assessment methodology; for developing guidelines for reporting and disseminating NAEP results; for 
developing standards and procedures for interstate, regional, and national comparisons; for determining the appropriateness of test items 
and ensuring they are free from bias; and for taking actions to improve the form and use of the National Assessment. 

The National Assessment Governing Board 



Honorable William T. Randall, Chair 

Former Commissioner of Education 
State of Colorado 
Denver, Colorado 

Mary R. Blanton, Vice Chair 
Attorney 

Salisbury, North Carolina 

Patsy Cavazos 
Principal 

W.G. Love Accelerated Elementary School 
Houston, Texas 

Catherine A. Davidson 
Secondary Education Director 
Central Kitsap School District 
Silverdale, Washington 

Edward Donley 

Former Chairman 

Air Products & Chemicals, Inc. 

Allentown, Pennsylvania 

Honorable James Edgar 

Member Designate 
Governor of Illinois 
Springfield, Illinois 

James E. Ellingson 
Fourth-Grade Classroom Teacher 
Probstfield Elementary School 
Moorhead, Minnesota 

Thomas H. Fisher 

Director, Student Assessment Services 
Florida Department of Education 
Tallahassee, Florida 

Michael J. Guerra 
Executive Director 
Secondary Schools Department 
National Catholic Educational Association 
Washington, DC 

Edward H. Haertel 

Professor of Education 
Stanford University 
Stanford, California 



Jan B. Loveless 
President 

Loveless and Associates 
Midland, Michigan 

Marilyn McConachie 

Vice-Chairperson 

Illinois State Board of Education 

Northbrook, Illinois 

William J. Moloney 
Superintendent of Schools 
Calvert County Public Schools 
Prince Frederick, Maryland 

Honorable Annette Morgan 
Former Member 

Missouri House of Representatives 
Jefferson City, Missouri 

Mark D. Musick 
President 

Southern Regional Education Board 
Atlanta, Georgia 

Mitsugi Nakashima 
First Vice-Chairperson 
Hawaii State Board of Education 
Honolulu, Hawaii 

Michael T. Nettles 

Professor of Education & Public Policy 
University of Michigan 
Ann Arbor, Michigan 
and Director 

Frederick D. Patterson Research Institute 
United Negro College Fund 

Honorable Norma Paulus 
Superintendent of Public Instruction 
Oregon State Department of Education 
Salem, Oregon 

Honorable Roy Romer 

Governor of Colorado 
Denver, Colorado 



Honorable Edgar D. Ross 
Judge 

Territorial Court of the Virgin Islands 
Christiansted, St. Croix 
U.S. Virgin Islands 

Fannie L. Simmons 

Mathematics Coordinator 

District 5 of Lexington/Richland County 

Ballentine, South Carolina 

Adam Urbanski 

President 

Rochester Teachers Association 
Rochester, New York 

Deborah Voltz 

Assistant Professor 
Department of Special Education 
University of Louisville 
Louisville, Kentucky 

Marilyn A. Whirry 
Twelfth-Grade English Teacher 
Mira Costa High School 
Manhattan Beach, California 

Dennie Palmer Wolf 

Senior Research Associate 
Harvard Graduate School of Education 
Cambridge, Massachusetts 

Ramon C. Cortines (Ex-Officio) 

Acting Assistant Secretary 
Office of Educational Research 
and Improvement 
U.S. Department of Education 
Washington, DC 



Roy Truby 

Executive Director, NAGB 
Washington, DC 



3 



NATIONAL CENTER FOR EDUCATION STATISTICS 



NAEP 1996 SCIENCE STATE REPORT 

for 

SOUTH CAROLINA 



Christine Y. O’Sullivan 
Laura Jerry 
Nada Ballator 
Fiona Herr 



In collaboration with 
Audrey Champagne, Peggy Carr, 
Will Pfeiffenberger, and Mistilina Sato 



September 1997 



U.S. Department of Education 

Office of Educational Research and Improvement 



Prepared by Educational Testing Service under a cooperative 
agreement with the National Center for Education Statistics. 



U.S. Department of Education 

Richard W. Riley 
Secretary 

Office of Educational Research and Improvement 

Ramon C. Cortines 
Acting Assistant Secretary 

National Center for Education Statistics 

Pascal D. Forgione, Jr. 

Commissioner 

Education Assessment Group 

Gary W. Phillips 
Associate Commissioner 



September 1997 

SUGGESTED CITATION 

O’Sullivan, C.Y., Jerry, L., Ballator, N., and Herr, H. 

NAEP 1996 Science State Report for South Carolina , 

Washington, DC: National Center for Education Statistics, 1997. 

FOR MORE INFORMATION 

Contact: 

Arnold A. Goldstein 
202-219-1741 

For ordering information on this report, write: 

National Library of Education 

Office of Educational Research and Improvement 

U.S. Department of Education 

555 New Jersey Avenue, NW 

Washington, D.C. 20208-5641 

or call 1-800-424-1616 (in the Washington, DC, metropolitan area call 202-219-1651). 

This report also is available on the World Wide Web: http://www.ed.gov/NCES/naep 

The work upon which this publication is based was performed for the National Center for Education Statistics, 
Office of Educational Research and Improvement, by Educational Testing Service. 

Educational Testing Service is an equal opportunity, affirmative action employer. 

Educational Testing Service , ETS, and the ETS logo are registered trademarks of Educational Testing Service. 




5 



Table of Contents 

HIGHLIGHTS 1 

INTRODUCTION 7 

What Was Assessed? 8 

Who Was Assessed? 9 

Reporting NAEP Science Results 14 

Interpreting NAEP Results 15 

How Is This Report Organized? 16 

Other Reports of NAEP 1996 Science Results 17 

PART ONE Science Scale Score Results 19 

Item Maps 20 

CHAPTER 1 Science Scale Score Results for Eighth-Grade Students 23 

Comparisons Between South Carolina and Other Participating 

Jurisdictions 25 

Performance in the NAEP Fields of Science 29 

CHAPTER 2 Science Scale Score Results for Eighth-Grade Students by 

Subpopulations 31 

Gender 32 

Race/Ethnicity 33 

Students’ Reports of Parents’ Highest Education Level 34 

Title I Participation 36 

Free/Reduced-Price Lunch Program Eligibility 37 

PART TWO Finding a Context for Understanding Students’ Science 

Performance in Public Schools 39 

CHAPTER 3 School Science Education Policies and Practices 41 

Emphasis on Science in the School 41 

Resource Availability to Teachers 43 

Parents as Classroom Aides 46 

Student Absenteeism 47 



THE NAEP 1996 STATE ASSESSMENT IN SCIENCE 



6 



i 



CHAPTER 4 Science Classroom Practices 



.49 



Curriculum Coverage 50 

Eighth-Grade Students’ Course Taking 52 

Instructional Emphasis 54 

Science Homework 57 

Computer Use in Science Instruction 60 

CHAPTER 5 Student Performance on Hands-On Science Tasks 65 

NAEP Hands-On Science Tasks 66 

Sample Questions from a Task 67 

Instruction Related to Scientific Investigation 69 

CHAPTER 6 Influences Beyond School that Facilitate Learning Science 75 

Discussing Studies at Home 76 

Literacy Materials in the Home 77 

Television Viewing Habits 78 

Parental Support , 80 

Student Mobility 81 

Students’ Views About Science 82 

APPENDIX A Reporting NAEP 1996 Science Results 83 

APPENDIX B The NAEP 1996 Science Assessment 99 

APPENDIX C Technical Appendix: The Design, Implementation, 

and Analysis of the 1996 State Assessment Program in Science 107 

APPENDIX D Teacher Preparation 121 

ACKNOWLEDGMENTS 127 



7 



ii 



THE NAEP 1996 STATE ASSESSMENT IN SCIENCE 



South Carolina 



HIGHLIGHTS 



^^onitoring the performance of students in subjects such as science is a key 
concern of the citizens, policy makers, and educators who direct educational reform 
efforts. The 1996 National Assessment of Educational Progress (NAEP) in science 
assesses the current level of science performance as a mechanism for informing 
education reform. This science assessment is the first to be constructed on a new 
framework, and it is also the first to be given at the state level. This report contains 
results for public school students at grade 8. 

What Is NAEP? 

The National Assessment of Educational Progress (NAEP), the “Nation’s Report 
Card,” is the only ongoing nationally representative assessment of what America’s 
students know and can do in various acade mi c subjects. Since 1969, NAEP assessments 
have been conducted with national samples of students in the areas of reading, 
mathematics, science, writing, and other fields. By making information on student 
performance available to policy makers, educators, and the general public, NAEP is an 
integral part of our nation’s evaluation of the conditions and progress of education. 

NAEP is a congressionally mandated project of the National Center for Education 
Statistics, U.S. Department of Education. Results are provided only for group 
performance. NAEP is forbidden by law to report results at an individual or school 
level. 

In 1990 Congress authorized a voluntary state-by-state NAEP assessment The 
1990 Trial State Assessment in mathematics at grade 8 was the first state-level NAEP 
assessment. Since then, state-level assessments have taken place in 1992 and 1994 in 
reading (grade 4), in 1992 and 1996 in mathematics (grades 4 and 8), and in 1996 in 
science (grade 8). In 1996, 44 states, the District of Columbia, Guam, and the 
Department of Defense Schools took part in the NAEP state assessment program. The 
NAEP 1996 state science assessment was at grade 8 only, although grades 4, 8, and 12 
were assessed at the national level as usual. 
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NAEP 1996 Science Assessment 

The NAEP 1996 science assessment was developed using a new framework. This 
framework was produced by educators, administrators, assessment experts, and 
curriculum specialists using a national consensus process. The framework was designed 
to reflect current practices in science teaching. It called for the use of multiple-choice 
questions and constructed-response questions that required both short and extended 
responses. The constructed-response questions served as indicators of students’ ability 
to know and integrate facts and scientific concepts, their ability to reason, and their 
ability to communicate scientific information. In the 1996 assessment, these 
constructed-response questions constituted nearly 80 percent of the total student response 
time. The NAEP 1996 assessment in science also included hands-on tasks that enabled 
students to demonstrate directly their knowledge and skills related to scientific 
investigation. 

The 1996 science framework was structured according to a matrix that consisted 
of the three traditional fields of science (earth, physical, and life) crossed with three 
processes of knowing and doing science (conceptual Understanding, scientific 
investigation, and practical reasoning). A central category encompassing the nature of 
science and the nature of technology was woven throughout the assessment, as was a 
themes category representing major ideas or key concepts that transcend scientific 
disciplines. 1 

Students’ science performance is summarized on the NAEP science scales, which 
range from 0 to 300 at each grade. While the scale score ranges are identical for grades 
4, 8, and 12, the scales were derived independently at each grade. For example, scale 
scores on the grade 8 scale cannot imply anything about performance at grade 12 in the 
national assessment. The science scale is discussed in Appendix C of this report, the 
NAEP 1996 Science State Report for South Carolina (see C.9). Note that the national 
average for the combined public and nonpublic school population is 150; the average 
for public schools only (appropriate for most tables in this report) is 148. 

Comparison of South Carolina to the Nation 

Table H.l shows the distribution of science scale scores for eighth-grade students 
attending public schools in South Carolina, the Southeast region, and the nation in 1996. 

• The average science scale score for eighth graders in public schools in 
South Carolina was 139. This average was lower than that for public 
school students across the nation (148). 2 
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More details about the NAEP 1996 science assessment can be found in Appendix B of this report, the NAEP 1996 
Science State Report for South Carolina. 

2 

Differences reported as significant are statistically different at the 95 percent confidence level. This means that with 
95 percent confidence there is a real difference in the average science scale score between the two populations of 
interest. 
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TABLE H.1 


Distribution of Science Scale Scores for Public School 
Students at Grade 8 


State Assessment 





Average 
Scale Score 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 




South Carolina 

Southeast 

Nation 


139 ( 1.5) 
141 ( 1.9) 
148 ( 0.9) 


96 ( 2.2) 116(1.9) 139( 1.8) 161 ( 1.9) 180( 1.9) 

96 ( 2.9) 118 ( 2.7) 143 ( 2.1) 165 ( 1.9) 183( 1.2) 

102( 1.6) 126(1.3) 151 (0.9) 172( 1.1) 191 ( 1.3) 



The NAEP science scale ranges from 0 to 300. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the es timate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 Science 
Assessment 



Major Findings for Student Subpopulations 

The preceding section provided a view of the overall science performance of 
eighth-grade students in South Carolina. It is also important to examine the average 
science scale scores of subgroups within the population. Typically, NAEP presents 
results for demographic subgroups defined by gender, race/ethnicity, and parental 
education. In addition, in 1996 NAEP collected information on student participation in 
two federally funded programs: Title I programs and the free/reduced-price lunch 
component of the National School Lunch Program. 

The reader is cautioned against using NAEP results to make simple or causal 
inferences related to subgroup membership. Differences among groups of students are 
almost certainly associated with a broad range of socioeconomic and educational factors 
not discussed in NAEP reports and possibly not addressed by the NAEP assessment 
program. 
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Results related to gender and race/ethnicity for public school students are 
highlighted below. More complete results for the various demographic subgroups 
examined by the NAEP science assessment can be found in Chapter 2 of this report, the 
NAEP 1996 Science State Report for South Carolina. 

• The average science scale score of males was higher than that of females 
in South Carolina; nationwide, however, the performance of males did 
not differ significantly from that of females. 

• At the eighth grade. White students in South Carolina had an average 
science scale score that was higher than those of Black and Hispanic 
students. 

Finding a Context for Understanding Students’ Science Performance 
in Public Schools 

The science performance of students in South Carolina may be better understood 
when viewed in the context of the environment in which students are learning. This 
educational environment is largely determined by school policies and practices, by 
characteristics of science instruction in the school, by home support for academics and 
other home influences, and by students’ own views about science. Information about 
this environment is gathered by means of questionnaires completed by principals and 
teachers as well as questions answered by students as part of the assessment. 

Because NAEP is administered to a sample of students that is representative of 
all eighth-grade students in South Carolina schools, NAEP results provide a view of the 
educational practices in South Carolina that may be useful for improving instruction and 
setting policy. However, despite the richness of context provided by the NAEP results, 
it is very important to note that NAEP data cannot establish a cause-and-effect 
relationship between educational environment and students’ scores on the NAEP science 
assessment. 
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